Imaging device and imaging method for augmented reality apparatus

ABSTRACT

The present disclosure provides in some embodiments an imaging device and an imaging method for an AR apparatus. The imaging method includes steps of: achieving, by the AR apparatus, to be in communication with a terminal device; receiving, by the AR apparatus, image data from the terminal device; and displaying, by the AR apparatus, the image data.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to Chinese Patent Application No.201710907251.1 filed on Sep. 29, 2017, which is incorporated herein byreference in its entirety.

TECHNICAL FIELD

The present disclosure relates to the manufacture of an intelligentdevice, in particular to an imaging device and an imaging method for anAugmented Reality (AR) apparatus.

BACKGROUND

Recently, there are more and more types of terminal devices each with anelectronic display screen, e.g., desktop computers, lap-top computers,mobile phones and e-book readers. Usually, these terminal devices areused in some public places, e.g., Internet bars, subways or buses. Inthe case that some contents displayed on these terminal devices need tobe kept confidential, it is necessary to prevent these contents frombeing viewed by any other person at the side.

SUMMARY

In one aspect, the present disclosure provides in some embodiments animage method for an AR apparatus, including steps of: achieving, by theAR apparatus, to be in communication with a terminal device; receiving,by the AR apparatus, image data from the terminal device; anddisplaying, by the AR apparatus, the image data.

In a possible embodiment of the present disclosure, prior to the step ofdisplaying, by the AR apparatus, the image data, the imaging methodfurther includes determining, by the AR apparatus, whether or not theterminal device has been unlocked. The step of displaying, by the ARapparatus, the image data includes, in the case that the terminal devicehas been unlocked, displaying, by the AR device, the image data.

In a possible embodiment of the present disclosure, the step ofdetermining, by the AR apparatus, whether or not the terminal device hasbeen unlocked includes: capturing, by the AR apparatus, a first imagecontaining a current image displayed on the terminal device; comparing,by the AR apparatus, the first image with a pre-stored target image; andin the case that the first image matches the target image, determining,by the AR apparatus, that the terminal device has been unlocked. Thetarget image contains an image displayed on the terminal device duringor after an unlocking operation.

In a possible embodiment of the present disclosure, the step ofdisplaying, by the AR apparatus, the image data includes displaying, bythe AR apparatus, the image data in accordance with a distance betweenthe AR apparatus and the terminal device and a size of an imaging regionof the terminal device, so as to display the image data at the imagingregion of the terminal device. The imaging region of the terminal deviceis located within a contour of the terminal device.

In a possible embodiment of the present disclosure, the step ofdisplaying, by the AR apparatus, the image data in accordance with thedistance between the AR apparatus and the terminal device and the sizeof the imaging region of the terminal device includes: scaling, by theAR apparatus, the image data in accordance with a proportion of a sizeof an image currently configured by the AR apparatus to the size of theimaging region of the terminal device; adjusting, by the AR apparatus,an imaging distance of the AR apparatus in accordance with the distancebetween the AR apparatus and the terminal device; and displaying, by theAR apparatus, the resultant image data.

In a possible embodiment of the present disclosure, prior to the step ofscaling, by the AR apparatus, the image data, the imaging method furtherincludes: acquiring, by the AR apparatus, two second images of theterminal device from different perspectives; determining, by the ARapparatus, vertex coordinates of the imaging region on each of the twosecond images; subjecting, by the AR apparatus, the vertex coordinatesto treatment on the basis of a disparity principle, so as to acquirecontour coordinates of the imaging region; and acquiring, by the ARapparatus, a length and a width of the imaging region in accordance withthe contour coordinates.

In a possible embodiment of the present disclosure, the step ofadjusting, by the AR apparatus, the imaging distance of the AR apparatusin accordance with the distance between the AR apparatus and theterminal device includes: subjecting, by the AR apparatus, the acquiredimage data to treatment so as to acquire a left-eye image and aright-eye image, and adjusting a pixel offset of the left-eye imagedisplayed on a left-eye lens of the AR apparatus and/or a pixel offsetof the right-eye image displayed on a right-eye lens of the AR apparatusin accordance with the distance between the AR apparatus and theterminal device; or adjusting, by the AR apparatus, a distance betweeneach of the left-eye lens and the right-eye lens and a correspondingobjective lens of the AR apparatus.

In a possible embodiment of the present disclosure, the step ofdetermining, by the AR apparatus, whether or not the terminal device hasbeen unlocked precedes the step of enabling the AR apparatus to be incommunication with the terminal device.

In a possible embodiment of the present disclosure, the step ofdetermining, by the AR apparatus, whether or not the terminal device hasbeen unlocked follows the step of enabling the AR apparatus to be incommunication with the terminal device and precedes the step ofreceiving, by the AR apparatus, the image data from the terminal device.

In another aspect, the present disclosure provides in some embodimentsan imaging method for an AR apparatus, including steps of: achieving, bya terminal device, to be in communication with the AR apparatus; andtransmitting, by the terminal device, image data containing ato-be-displayed image generated during the operation of the terminaldevice to the AR apparatus, and disenabling a display function of theterminal device.

In yet another aspect, the present disclosure provides in someembodiments an AR apparatus, including: a communication circuitconfigured to be in communication with a terminal device and receiveimage data from the terminal device; and a display circuit configured todisplay the image data.

In a possible embodiment of the present disclosure, the AR apparatusfurther includes: an image capturing circuit configured to capture afirst image containing a current image displayed on the terminal device;a storage circuit configured to store therein a target image containingan image displayed on the terminal device during or after an unlockingoperation; and a processing circuit configured to determine whether ornot the first image matches the target image.

In a possible embodiment of the present disclosure, the storage circuitis configured to store therein the target image containing the imagedisplayed on the terminal device during or after the unlockingoperation, and the first image matching the target image.

In a possible embodiment of the present disclosure, the processingcircuit is further configured to scale the image data in accordance witha proportion of a size of an image currently configured by the ARapparatus to the size of the imaging region of the terminal device, andadjust an imaging distance of the AR apparatus in accordance with adistance between the AR apparatus and the terminal device.

In a possible embodiment of the present disclosure, the image capturingcircuit includes two cameras.

In a possible embodiment of the present disclosure, the image capturingcircuit includes one camera.

In still yet another aspect, the present disclosure provides in someembodiments a terminal device, including a memory, a processor and atransceiver connected to each other via a bus. The processor isconfigured to execute a program stored in the memory, so as to implementthe above-mentioned imaging method for the AR apparatus.

In still yet another aspect, the present disclosure provides in someembodiments a non-transient computer-readable storage medium storingtherein an instruction, which is operated on an AR apparatus, so as toenable the AR apparatus to implement the above-mentioned imaging methodfor the AR apparatus, or which is operated on a terminal device, so asto enable the terminal device to implement the above-mentioned imagingmethod for the AR apparatus.

In still yet another aspect, the present disclosure provides in someembodiments a computer program product including an instruction. Thecomputer program product is operated on an AR apparatus, so as to enablethe AR apparatus to implement the above-mentioned imaging method for theAR apparatus, or the computer program product is operated on a terminaldevice, so as to enable the terminal device to implement theabove-mentioned imaging method for the AR apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to illustrate the technical solutions of the present disclosureor the related art in a clearer manner, the drawings desired for thepresent disclosure or the related art will be described hereinafterbriefly. Obviously, the following drawings merely relate to someembodiments of the present disclosure, and based on these drawings, aperson skilled in the art may obtain the other drawings without anycreative effort.

FIG. 1 is a flow chart of an imaging method for an AR apparatusaccording to one embodiment of the present disclosure;

FIG. 2 is another flow chart of the imaging method for the AR apparatusaccording to one embodiment of the present disclosure;

FIG. 3 is yet another flow chart of the imaging method for the ARapparatus according to one embodiment of the present disclosure;

FIG. 4A is a schematic view showing an image containing an imagecurrently displayed on a terminal device according to one embodiment ofthe present disclosure;

FIG. 4B is another schematic view showing an image containing an imagecurrently displayed on the terminal device according to one embodimentof the present disclosure;

FIG. 4C is yet another schematic view showing an image containing animage currently displayed on the terminal device according to oneembodiment of the present disclosure;

FIG. 5 is a schematic view showing a principle of two-dimensional (2D)display;

FIG. 6 is a schematic view showing a principle of three-dimensional (3D)display;

FIG. 7 is a schematic view showing a principle of binocular visionaccording to one embodiment of the present disclosure;

FIG. 8 is a schematic view showing a position relationship between theAR apparatus and the terminal device according to one embodiment of thepresent disclosure;

FIG. 9 is a flow chart of an imaging method for an AR apparatusaccording to one embodiment of the present disclosure;

FIG. 10 is a block diagram of an AR apparatus 1000 according to oneembodiment of the present disclosure; and

FIG. 11 is a block diagram of a terminal device 2000 according to oneembodiment of the present disclosure.

DETAILED DESCRIPTION

In order to make the objects, the technical solutions and the advantagesof the present disclosure more apparent, the present disclosure will bedescribed hereinafter in a clear and complete manner in conjunction withthe drawings and embodiments. Obviously, the following embodimentsmerely relate to a part of, rather than all of, the embodiments of thepresent disclosure, and based on these embodiments, a person skilled inthe art may, without any creative effort, obtain the other embodiments,which also fall within the scope of the present disclosure.

Such words as “first” and “second” used in the specification and claimsare merely used to differentiate different components rather than torepresent any order, number or importance. Hence, in the case anyfeature is defined by “first” or “second”, it may explicitly orimplicitly mean that one or more features are included.

First Embodiment

The present disclosure provides in this embodiment an imaging method foran AR apparatus. The imaging method may be implemented by the ARapparatus, e.g., hardware of the AR apparatus and/or software run on theAR apparatus. Correspondingly, the AR apparatus mentioned hereinaftermay not only refer to the entire AR apparatus, but also to all of orpart of the hardware of the AR apparatus and/or the software run on theAR apparatus. As shown in FIG. 1, the imaging method may include thefollowing Steps S10 to S30, for example.

Step S10: achieving, by the AR apparatus, to be in communication with aterminal device. Here, the AR apparatus may communicate with theterminal device in a wired or wireless manner.

In the case that the AR apparatus communicates with the terminal devicein a wired manner, the AR apparatus and the terminal device may be eachprovided with a data transmission interface, e.g., at least one of aUniversal Serial Bus (USB) interface, a mini-USB interface, and alightning interface. The USB interface and the mini-USB interface may beapplicable to the terminal device installed with an Android system,while the lightning interface may be applicable to the terminal deviceinstalled with an iOS or Mac OS system. Correspondingly, the ARapparatus may be provided with any one or more of the above-mentioneddata transmission interfaces. In the case that the AR apparatuscommunicates with the terminal device in a wireless manner, the ARapparatus and the terminal device may be each provided with a Bluetoothmodule or a Wireless-Fidelity (WiFi) module. In a possible embodiment ofthe present disclosure, the AR apparatus is mainly configured to receivedata, so it may be provided with a data reception function rather than adata transmission function, regardless of the type of the communicationwith the terminal device. At this time, the AR apparatus may be providedwith a WiFi reception module. Of course, the AR apparatus may also beprovided with both the data reception function and the data transmissionfunction, which will not be particularly defined herein.

The terminal device may include any type of terminal device, e.g., amobile phone, a wearable device, a flat-panel computer, a lap-topcomputer, an Ultra Mobile Personal Computer (UMPC), a netbook, or aPersonal Digital Assistant (PDA), which will not be particularly definedherein.

In addition, the AR apparatus may include monocular glasses or binocularglasses.

Step S20: receiving, by the AR apparatus, image data from the terminaldevice. In other words, the terminal device may generate the image datain accordance with a to-be-displayed image (i.e., an image that shouldhave been displayed on a display screen of the terminal device), andtransmit the generated image data to the AR apparatus.

Step S30: displaying, by the AR apparatus, the image data.

In a possible embodiment of the present disclosure, an imaging distanceof the AR apparatus (e.g., the AR glasses) may be adjusted to be equalto a distance between the AR apparatus and the terminal device (athickness of the terminal device may be omitted). At this time, a planewhere the terminal device is located may serve as an image plane of theAR apparatus. In the case that the AR apparatus is used by a user, theimage data is just displayed on the terminal device.

According to the imaging method in this embodiment of the presentdisclosure, the to-be-displayed image of the terminal device isprojected by the AR apparatus to a display surface of the terminaldevice, so as to merely enable the user wearing the AR apparatus to viewthe image displayed on the display surface of the terminal device, andprevent any other person from viewing the image. As a result, it is ableto display the image in a private manner.

In a possible embodiment of the present disclosure, as shown in FIG. 2and FIG. 3, the imaging method may further include the following steps.

Step S01: determining, by the AR apparatus, whether or not the terminaldevice has been unlocked. Depending on different ways for determiningwhether or not the terminal device has been unlocked, Step S01 mayprecede Step S20 or Step S10, but it must precede Step S30. In otherwords, the AR apparatus may display the image data merely in the casethat the terminal device has been unlocked.

In a possible embodiment of the present disclosure, in the case that theAR apparatus determines whether or not the terminal device has beenunlocked through capturing and analyzing the image currently displayedon the display device, Step S01 may precede Step S10. At this time, theAR apparatus may be in communication with the terminal device merely inthe case that the terminal device has been unlocked. In another possibleembodiment of the present disclosure, in the case that the AR apparatusdetermines whether or not the terminal device has been unlocked throughdetermining whether or not an unlocking signal is transmitted from theterminal device to the AR apparatus, Step S01 may precede Step S20. Atthis time, the AR apparatus may receive the image data from the terminaldevice merely in the case that the terminal device has been unlocked. Ina word, the AR apparatus may display the image data merely in the casethat the terminal device has been unlocked.

Here, the AR apparatus may project the image data after the terminaldevice has been unlocked, so as to prevent an undesired image from beingprojected by the AR apparatus, thereby to reduce a burden of the ARapparatus.

In a possible embodiment of the present disclosure, Step S01 mayinclude: capturing, by the AR apparatus, a first image containing acurrent image displayed on the terminal device; comparing, by the ARapparatus, the first image with the pre-stored target image; and in thecase that the first image matches the target image, determining, by theAR apparatus, that the terminal device has been unlocked. The targetimage contains the image displayed on the terminal device during orafter an unlocking operation.

Here, in actual use, the AR apparatus may perform a capturing operationfor one time so as to acquire the first image matching the target image.Of course, the AR apparatus may perform the capturing operation for morethan one times, so as to acquire the first image matching the targetimage. In addition, the first image may be captured in real time inaccordance with the user's requirements.

In a possible embodiment of the present disclosure, the terminal devicemay be unlocked via a gesture. FIG. 4A shows an image acquired in thecase that the terminal device has not yet been unlocked. FIG. 4B showsan image acquired during the unlocking operation of the terminal device.And FIG. 4C shows an image acquired after the unlocking operation of theterminal device. The target image may be the image shown in FIG. 4B orFIG. 4C.

It should be appreciated that, the first image and the target image mayeach be an image containing the current image, i.e., an image containingthe image currently displayed on the display screen. A pattern at anon-display region (e.g., grey regions in FIG. 4A, FIG. 4B and FIG. 4C)will not be particularly defined, so as to meet the user's requirementson decorations at the non-display region of the terminal device.

In a possible embodiment of the present disclosure, Step S30 may includedisplaying, by the AR apparatus, the image data in accordance with adistance between the AR apparatus and the terminal device and a size ofan imaging region of the terminal device, so as to display the imagedata at the imaging region of the terminal device. The imaging region ofthe terminal device may be located within a contour of the terminaldevice.

Here, in the case that a line of sight of the user wearing the ARapparatus is directed toward the terminal device, the AR apparatus maydisplay the image data at the imaging region of the terminal device. Inthe case that the line of sight of the user wearing the AR apparatus isdirected toward any other direction, the AR apparatus may display theimage data at a region related to the direction of the line of sight ofthe user.

The distance between the AR apparatus and the terminal device may be,but not limited to, a distance between a center of the AR apparatus anda center of the terminal device.

In the case that the imaging region of the terminal device is within thecontour of the terminal device, it may just cover the entire terminaldevice, or cover a display region of the terminal device, i.e., a regionwhere the display screen of the display device is located.

Further, the step of displaying, by the AR apparatus, the image data inaccordance with the distance between the AR apparatus and the terminaldevice and the size of the imaging region of the terminal device mayinclude scaling, by the AR apparatus, the image data in accordance witha proportion of a size of an image currently configured by the ARapparatus to the size of the imaging region of the terminal device.

In a possible embodiment of the present disclosure, the image currentlyconfigured by the AR apparatus has a size of M*N (length*width), and theimaging region of the terminal device has a size of A*B (length*width).An imaging system of the AR apparatus may perform a down scalaroperation on the image data in accordance with a contour of the imagingregion of the terminal device at a lateral scalar ratio of M/A and avertical scalar ratio of N/B.

Here, the imaging region of the terminal device may cover the entireterminal device, or cover merely a display region of the terminal device(i.e., a portion of the terminal device in FIG. 4A, FIG. 4B and FIG. 4Cother than the grey regions). The AR apparatus may adjust its imagingdistance in accordance with the distance between the AR apparatus andthe terminal device. In other words, after the adjustment of the imagingdistance of the AR apparatus, the image data may be just projected ontothe imaging region of the terminal device.

In a possible embodiment of the present disclosure, for 2D display, asshown in FIG. 5, the imaging distance b of the AR apparatus may becalculated using the equation: b=−1/(1/f−1/a), where “a” represents adistance between a screen and an objective lens of the AR apparatus, “b”represents the imaging distance of the AR apparatus (i.e., a distancebetween a virtual image and the lens of the AR apparatus), and “f”represents a focal length of the objective lens. Hence, it is able toadjust the imaging distance of the AR apparatus through adjusting thedistance “a” between the screen and the lens of the AR apparatus. Thescreen is just a left-eye or right-eye lens of the AR apparatus.

In a possible embodiment of the present disclosure, for 3D display, asshown in FIG. 6, the imaging distance of the AR apparatus may beadjusted through adjusting pixel positions in a left-eye image and aright-eye image acquired through the left-eye lens and the right-eyelens. The AR apparatus may display the resultant image data.

The step of scaling the image data and the step of adjusting the imagingdistance of the AR apparatus may be performed in any sequence, i.e.,they may be performed simultaneously, or one after another.

Further, prior to the step of scaling the image data, the imaging methodmay further include: acquiring, by the AR apparatus, two second imagesof the terminal device from different perspectives; determining, by theAR apparatus, vertex coordinates of the imaging region on each of thetwo second images; subjecting, by the AR apparatus, the vertexcoordinates to treatment on the basis of a disparity principle, so as toacquire contour coordinates of the imaging region; and acquiring, by theAR apparatus, a length and a width of the imaging region in accordancewith the contour coordinates.

To be specific, in the case that the imaging region is the entiredisplay surface of the terminal device, the AR apparatus may acquire twosecond images of the terminal device from different perspectives. Here,the two second images may be acquired merely in the case that it isnecessary to calculate the length and width of the imaging region. In apossible embodiment of the present disclosure, after the first imagematches the target image, two sub-images for forming the first image maybe stored as the two second images.

Next, the AR apparatus may determine vertex coordinates of the imagingregion on each of the two second images. For example, the imaging regionmay be of a rectangular shape, and there may be four sets of vertexcoordinates.

Next, the AR apparatus may subject the vertex coordinates to treatmenton the basis of a disparity principle, so as to acquire contourcoordinates of the imaging region.

By taking one vertex as an example, two second images may be acquiredthrough a camera from two different perspectives. In a possibleembodiment of the present disclosure, as shown in FIG. 7, the two secondimages may also be acquired through two cameras. For a vertex P(x_(c),y_(c), z_(c)) of the imaging region, its coordinates on a left image isp_(left)=(X_(left), Y_(left)), while its coordinates on a right image isp_(right)=(X_(right), Y_(right)).

The two second images are acquired by the two cameras in an identicalplane, so the vertex P has an identical Y-axis coordinate on the twoimages, i.e., Y_(left)=Y_(right)=Y. On the basis of a triangulargeometrical relationship, the following equations may be acquired:

$\{ {\begin{matrix}{X_{left} = {f\frac{x_{c}}{z_{c}}}} \\{X_{right} = {f\frac{( {x_{c} - B} )}{z_{c}}}} \\{Y = {f\frac{y_{c}}{z_{c}}}}\end{matrix},} $

where B represents a length of a line connecting projection centers ofthe two cameras, and f represents a focal length of each camera.

The disparity may be calculated using the following equation:Disparity=X_(left)−X_(right). At this time, 3D coordinates of the vertexP in a camera-based coordinate system may be calculated using thefollowing equations:

$\{ {\begin{matrix}{x_{c} = \frac{B*X_{left}}{Disparity}} \\{y_{c} = \frac{B*Y}{Disparity}} \\{z_{c} = \frac{B*f}{Disparity}}\end{matrix}.} $

The coordinates of each of the four vertices of the image region may bedetermined as mentioned.

Next, the AR apparatus may acquire a length and a width of the imagingregion in accordance with the contour coordinates, i.e., calculate adistance between the corresponding vertices of the imaging regions.

In the case that the terminal device is arranged parallel to the ARapparatus, a distance between the center of the terminal device and thecenter of the AR apparatus is just a value |z_(c)| of the contourcoordinates of the display surface of the terminal device in a Z-axisdirection. In the case that the terminal device is not arranged parallelto the AR apparatus, as shown in FIG. 8, coordinates of the center ofthe AR apparatus may be set as (0, 0, 0), and coordinates of a centerpoint G of the display surface of the terminal device may be

$( {{\frac{1}{2}( {x_{1} + x_{2}} )},{\frac{1}{2}( {y_{1} + y_{2}} )},{\frac{1}{2}( {z_{1} + z_{2}} )}} ),$

i.e., the distance between the center G of the display surface of theterminal device and the center of the AR apparatus may be

$\sqrt{\lbrack {( {{\frac{1}{2}( {x_{1} + x_{2}} )} - 0} \rbrack^{2} + \lbrack {{\frac{1}{2}( {y_{1} + y_{2}} )} - 0} \rbrack^{2} + \lbrack {{\frac{1}{2}( {z_{1} + z_{2}} )} - 0} \rbrack^{2}} )}.$

Coordinates of a point E on the contour of the display surface of theterminal device is (x1, y1, z1), and coordinates of a point F on thecontour of the display surface of the terminal device is (x2, y2, z2).Both the points E and F are two vertices of the contour of the terminaldevice at two diagonal positions.

Further, the step of adjusting, by the AR apparatus, the imagingdistance of the AR apparatus in accordance with the distance between theAR apparatus and the terminal device may include: for the 3D display,subjecting, by the AR apparatus, the acquired image data to treatment soas to acquire a left-eye image and a right-eye image, and adjusting apixel offset of the left-eye image displayed on a left-eye lens of theAR apparatus and/or a pixel offset of the right-eye image displayed on aright-eye lens of the AR apparatus in accordance with the distancebetween the AR apparatus and the terminal device.

In other words, a depth of field of a 3D image is adjusted throughadjusting the pixel offset. For the left-eye and right-eye data of the3D image, each left-eye pixel moves to the right while each right-eyepixel moves to the left, and the other pixels are turned off so as tonot emit light. At this time, the depth of field of the 3D image maydecrease. In addition, for the left-eye and right-eye data of the 3Dimage, each left-eye pixel moves to the left while each right-eye pixelmoves to the right, and the other pixels are turned off so as to notemit light. At this time, the depth of field of the 3D image mayincrease. There is a one-to-one correspondence between the depth offield and the pixel offset. The pixel offsets and the distances betweenthe terminal device and the AR apparatus (i.e., actual imagingdistances) may be measured in advance to form a table, and then thepixel offset may be acquired from the table in accordance with thedistance between the terminal device and the AR apparatus.

For the 2D display, as shown in FIG. 5, the AR apparatus may adjust adistance between each of the left-eye lens and the right-eye lens and acorresponding objective lens of the AR apparatus.

Second Embodiment

The present disclosure further provides in this embodiment an imagingmethod for an AR apparatus. The imaging method may be implemented by aterminal device, e.g., hardware of the terminal device and/or softwarerun on the terminal device. Correspondingly, the terminal devicementioned hereinafter may not only refer to the entire terminal device,but also to the hardware of the terminal device and/or the software runon the terminal device. As shown in FIG. 9, the imaging method mayinclude: Step S100 of achieving, by a terminal device, to be incommunication with the AR apparatus; and Step S200 of transmitting, bythe terminal device, image data containing a to-be-displayed imagegenerated during the operation of the terminal device to the ARapparatus, and disenabling a display function of the terminal device.

To be specific, a backlight source of the terminal device may be turnedoff, so as to disenable the display function of the terminal device. Atthis time, the terminal device may operate normally, but may not displaythe image. Of course, the transmitted image data may be updated in realtime.

In a possible embodiment of the present disclosure, an interactionbetween the AR apparatus and the terminal device will be describedhereinafter. The AR apparatus may determine whether or not the terminaldevice has been unlocked. In the case that the terminal device has beenunlocked, the AR apparatus may be in communication with the terminaldevice. The terminal device may generate the image data containing theto-be-displayed image generated during the operation of the terminaldevice, and transmit the image data to the AR apparatus. Upon thereceipt of the image data from the terminal device, the AR apparatus mayscale the image data in accordance with the proportion of the size ofthe image currently configured by the AR apparatus to the size of theimaging region of the terminal device, and then adjust the imagingdistance of the AR apparatus in accordance with the distance between theAR apparatus and the terminal device. Finally, the AR apparatus maydisplay the resultant image data.

At this time, no image data is displayed on the terminal device, so itis merely able for the user wearing the AR apparatus to view the imagecurrently displayed on the terminal device.

Third Embodiment

As shown in FIG. 10, the present disclosure further provides in thisembodiment an AR apparatus 1000, which includes: a communication circuit1010 configured to be in communication with a terminal device andreceive image data from the terminal device; and a display circuit 1020configured to display the image data.

In the case that the AR apparatus is a pair of AR glasses, it mayfurther include a glass body.

In a possible embodiment of the present disclosure, in the case that theAR apparatus needs to determine whether or not the terminal device hasbeen unlocked, the AR apparatus may further include: an image capturingcircuit 1030 configured to capture a first image containing a currentimage displayed on the terminal device; a storage circuit 1040configured to store therein a target image containing an image displayedon the terminal device during or after an unlocking operation; and aprocessing circuit 1050 configured to determine whether or not the firstimage matches the target image.

In a possible embodiment of the present disclosure, the storage circuitis further configured to store the first image matching the targetimage. In other words, in the case that the first image matches thetarget image, the first image may be stored.

In a possible embodiment of the present disclosure, the processingcircuit is further configured to scale the image data in accordance witha proportion of a size of an image currently configured by the ARapparatus to the size of the imaging region of the terminal device, andadjust an imaging distance of the AR apparatus in accordance with adistance between the AR apparatus and the terminal device.

In order to acquire a more accurate measurement result of contourcoordinates of a display surface of the terminal device, in a possibleembodiment of the present disclosure, the image capturing circuit mayinclude two cameras.

Fourth Embodiment

The present disclosure further provides in this embodiment a terminaldevice 2000, which includes: a processing circuit 2010 configured togenerate image data containing a to-be-displayed image generated duringthe operation of the terminal device; and a communication circuit 2020configured to enable the terminal device to be in communication with anAR apparatus and transmit the image data to the AR apparatus.

In addition, the image data may be converted into data in a formatcapable of being transmitted through the communication circuit inaccordance with the practical need.

Fifth Embodiment

The present disclosure further provides in this embodiment acomputer-readable storage medium storing therein an instruction, whichis operated on an AR apparatus, so as to enable the AR apparatus toimplement the above-mentioned imaging method for the AR apparatus, orwhich is operated on a terminal device, so as to enable the terminaldevice to implement the above-mentioned imaging method for the ARapparatus.

The computer-readable storage medium may be an optical disk storingtherein the instruction.

The present disclosure further provides in this embodiment a computerprogram product including an instruction. The computer program productis operated on an AR apparatus, so as to enable the AR apparatus toimplement the above-mentioned imaging method for the AR apparatus, orthe computer program product is operated on a terminal device, so as toenable the terminal device to implement the above-mentioned imagingmethod for the AR apparatus.

The computer program product including the instruction may be softwarecapable of being installed on the terminal device.

It should be appreciated that, all or parts of the above-mentioned stepsmay be implemented via hardware related to programs or instructions. Theabove-mentioned program may be stored in a computer-readable storagemedium, and it may be executed, so as to implement the above-mentionedsteps. The storage medium may include any medium capable of storingtherein program codes, such as Read Only Memory (ROM), Random AccessMemory (RAM), magnetic disk or optical disk.

The above are merely the preferred embodiments of the presentdisclosure, but the present disclosure is not limited thereto.Obviously, a person skilled in the art may make further modificationsand improvements without departing from the spirit of the presentdisclosure, and these modifications and improvements shall also fallwithin the scope of the present disclosure.

What is claimed is:
 1. An imaging method for an Augmented Reality (AR)apparatus, comprising: achieving, by the AR apparatus, to be incommunication with a terminal device; receiving, by the AR apparatus,image data from the terminal device; and displaying, by the ARapparatus, the image data.
 2. The imaging method according to claim 1,wherein prior to the step of displaying, by the AR apparatus, the imagedata, the imaging method further comprises determining, by the ARapparatus, whether or not the terminal device has been unlocked, and thestep of displaying, by the AR apparatus, the image data comprises, inthe case that the terminal device has been unlocked, displaying, by theAR device, the image data.
 3. The imaging method according to claim 2,wherein the step of determining, by the AR apparatus, whether or not theterminal device has been unlocked comprises: capturing, by the ARapparatus, a first image containing a current image displayed on theterminal device; comparing, by the AR apparatus, the first image with apre-stored target image; and in the case that the first image matchesthe target image, determining, by the AR apparatus, that the terminaldevice has been unlocked, wherein the target image contains an imagedisplayed on the terminal device during or after an unlocking operation.4. The imaging method according to claim 1, wherein the step ofdisplaying, by the AR apparatus, the image data comprises displaying, bythe AR apparatus, the image data in accordance with a distance betweenthe AR apparatus and the terminal device and a size of an imaging regionof the terminal device, so as to display the image data at the imagingregion of the terminal device, wherein the imaging region of theterminal device is located within a contour of the terminal device. 5.The imaging method according to claim 4, wherein the step of displaying,by the AR apparatus, the image data in accordance with the distancebetween the AR apparatus and the terminal device and the size of theimaging region of the terminal device comprises: scaling, by the ARapparatus, the image data in accordance with a proportion of a size ofan image currently configured by the AR apparatus to the size of theimaging region of the terminal device; adjusting, by the AR apparatus,an imaging distance of the AR apparatus in accordance with the distancebetween the AR apparatus and the terminal device; and displaying, by theAR apparatus, the resultant image data.
 6. The imaging method accordingto claim 5, wherein prior to the step of scaling, by the AR apparatus,the image data, the imaging method further comprises: acquiring, by theAR apparatus, two second images of the terminal device from differentperspectives; determining, by the AR apparatus, vertex coordinates ofthe imaging region on each of the two second images; subjecting, by theAR apparatus, the vertex coordinates to treatment on the basis of adisparity principle, so as to acquire contour coordinates of the imagingregion; and acquiring, by the AR apparatus, a length and a width of theimaging region in accordance with the contour coordinates.
 7. Theimaging method according to claim 5, wherein the step of adjusting, bythe AR apparatus, the imaging distance of the AR apparatus in accordancewith the distance between the AR apparatus and the terminal devicecomprises subjecting, by the AR apparatus, the acquired image data totreatment so as to acquire a left-eye image and a right-eye image, andadjusting a pixel offset of the left-eye image displayed on a left-eyelens of the AR apparatus and/or a pixel offset of the right-eye imagedisplayed on a right-eye lens of the AR apparatus in accordance with thedistance between the AR apparatus and the terminal device.
 8. Theimaging method according to claim 5, wherein the step of adjusting, bythe AR apparatus, the imaging distance of the AR apparatus in accordancewith the distance between the AR apparatus and the terminal devicecomprises subjecting, by the AR apparatus, the acquired image data totreatment so as to acquire a left-eye image and a right-eye image, andadjusting, by the AR apparatus, a distance between each of the left-eyelens and the right-eye lens and a corresponding objective lens of the ARapparatus in accordance with the distance between the AR apparatus andthe terminal device.
 9. The imaging method according to claim 2, whereinthe step of determining, by the AR apparatus, whether or not theterminal device has been unlocked precedes the step of achieving, by theAR apparatus, to be in communication with the terminal device.
 10. Theimaging method according to claim 2, wherein the step of determining, bythe AR apparatus, whether or not the terminal device has been unlockedfollows the step of achieving, by the AR apparatus, to be incommunication with the terminal device and precedes the step ofreceiving, by the AR apparatus, the image data from the terminal device.11. An imaging method for an Augmented Reality (AR) apparatus,comprising: achieving, by a terminal device, to be in communication withthe AR apparatus; and transmitting, by the terminal device, image datacontaining a to-be-displayed image generated during the operation of theterminal device to the AR apparatus, and disenabling a display functionof the terminal device.
 12. An Augmented Reality (AR) apparatus,comprising: a communication circuit configured to be in communicationwith a terminal device and receive image data from the terminal device;and a display circuit configured to display the image data.
 13. The ARapparatus according to claim 12, further comprising: an image capturingcircuit configured to capture a first image containing a current imagedisplayed on the terminal device; a storage circuit configured to storetherein a target image containing an image displayed on the terminaldevice during or after an unlocking operation; and a processing circuitconfigured to determine whether or not the first image matches thetarget image.
 14. The AR apparatus according to claim 13, wherein theprocessing circuit is further configured to scale the image data inaccordance with a proportion of a size of an image currently configuredby the AR apparatus to the size of the imaging region of the terminaldevice, and adjust an imaging distance of the AR apparatus in accordancewith a distance between the AR apparatus and the terminal device. 15.The AR apparatus according to claim 13, wherein the image capturingcircuit comprises two cameras.
 16. The AR apparatus according to claim13, wherein the image capturing circuit comprises one camera.
 17. Aterminal device, comprising a memory, a processor and a transceiverconnected to each other via a bus, wherein the processor is configuredto execute a program stored in the memory, so as to implement theimaging method according to claim
 11. 18. A non-transistorycomputer-readable storage medium storing therein an instruction, whichis operated on an Augmented Reality (AR) apparatus, so as to enable theAR apparatus to implement the imaging method according to claim
 1. 19. Anon-transistory computer-readable storage medium storing therein aninstruction, which is operated on a terminal device, so as to enable theterminal device to implement the imaging method for the AR apparatusaccording to claim 11.